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The  purpose  of  this  paper  is  to  prove  the  existence  and  uniqueness  of  gen¬ 
eralized  solution  of  the  normed  Bellman  equation  with  degenerate  diffusion 
coefficients  and  also  to  prove  that  this  unique  solution  is  the  cost  func¬ 
tion  of  a  stochastic  control  problem  associated  with  the  normed  Bellman 
equation. 

We  can  apply  these  results  to  some  interesting  degenerate  and  nonlinear 
differential  equations. 
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0.  INTRODUCTION 


0.  1 


Consider  the  following  Bellman  equation  with  degenerate  diffusion  co¬ 
efficients: 

1  -  d 

inf{3  v  +y  l  a.  .  (ot,s,x)3. 9.v +£  b.  (a,s,x)3.v  -  cCa,s,x)v 
aeA  “  i . j  =1  13  1  1  i  =  l  1  1 

(0.1)  +  f  (a,s,x) }  =  0  (s,x)  e  (0,T)  *Rd. 

v(T,x)  =  g(x) ,  x  €  Rd 

where  d  5 2,  1  <  v  <  d.  a  *  (a„ ) ,  1  <  i ,  j  <  v,  is  a  positive  definite  matrix, 
which  is  written  as  a=oo*  (a*  denotes  the  transposed  matrix  of  a)  and 
a  is  a  (v,v) -matrix,  and  A  is  a  separable  metric  space. 

If  the  coefficients  a,  b,  c,  and  f  are  bounded  with  respect  to  ot,  then 
it  is  known  ([3])  that  under  suitable  conditions  about  regularities  and 
growth  there  exists  a  unique  generalized  solution  of  Equation  (0.1)  and 
furthermore,  it  is  the  cost  function  of  a  stochastic  control  problem  assoc¬ 
iated  with  Equation  (0.1). 

in  the  case  where  the  coefficients  are  not  bounded  with  respect  to  a, 
it  is  necessary  to  consider  a  modified  form  of  Equation  (0.1),  so  called, 
the  normed  Bellman  equation,  which  was  originally  considered  by  N.  V.  Krylov 
([5]).  This  case  is  very  important  from  the  point  of  view  of  application. 
There  are  also  several  results  in  this  case  ([3],  [4],  [5],  etc),  though 
they  are  rather  restrictive. 

In  this  paper,  we  shall  extend  these  results  to  more  general  cases,  in 
which  are  included  many  interesting  examples.  We  shall  also  discuss  some 
applications  to  degenerate  nonlinear  differential  equations. 


1.1 


1.  FORMULATION  AND  PRELIMINARIES 

Here  we  shall  consider  a  stochastic  control  problem  associated  with 
Equation  (0.1)  and  summarize  some  properties  of  the  cost  function.  All 
of  the  notations  follow  [3]. 

Let  T  be  a  finite  positive  number  which  is  fixed.  Let  A  be  a  separ¬ 
able  metric  space  which  is  a  countable  union  of  non-empty  increasing  sets 

A^:  A  =  U  Ar,  Ar+j  a  A^  (possibly  A^  = =  ...  =  A),  and  we  fix  this  re- 
—  l  j 

resentation.  Put  Q^.  =  (0,T)  «  R°  and  also  Q^,=  [0 ,T]  *  Ra.  For  each  (s,x)eQ^, 

consider  the  following  stochastic  control  problem  for  a  system  described 

by  stochastic  differential  equations  of  the  type: 

(1.1)  j'dX  =  b(ct  ,s+t,X  )dt  +  a  (a  ,s+t,X  )dg  ,  0<t<T-s 

J  t  Z  Z  Z  Z  t 

Vx> 

where  (6^) ,  0 < t s  T,  is  a  d-dimensional  Brownian  motion  process.  Assume 
that  the  coefficients  a  and  b  satisfy  the  following  conditions: 

(A.  1 )  |-o(a,t,x):  A  *  QT  Rd  ®  Rd  (dxd  -  matrix)  * 

b(a,t,x) :  A*  (d-  vector) 

We  assume  that  they  are  continuous  with  repsect  to  (a,t,x).  Moreover,  let 
there  exist  a  sequence  of  nonnegative  constants  { } ,  0  =  1.2,...,  such  that 
for  each  n, 

(1.2)  Jj  o(a,t,x)  -  a(a,t,y)  ||  +  |b(a,t,x)  -  b(a.t.y)  |  <  k  |x-y| , 
and 

(1.3)  ||  o(a.t.x)  ||  ♦  |b(a,t,x)  |  <  k  (1  +  |x|) 

for  allaeA^,  0  <  t  <T,  xeR^  and  y  e  R^  ( ||  •  ||  denotes  the  matrix  norm). 

~  ’  ” - * - - 

We  also  write  ^(t.x)  and  ba(t,x),  and  so  on. 


1.2 


Assume  further  that  for  each  cteA,  aa  and  ba e  C* ’ 2 (Q^) ,  and,  in  addi¬ 
tion,  all  of  their  derivatives  3  oa,  3.aa,  9.9,aa,  9  ba,  9.ba  and  9.9.ba, 

t  l  l  j  t  i  l  ] 

l<i,j<d,  satisfy  the  following  inequalities: 

There  exists  a  nonnegative  constant  m>0  such  that  for  all  nH  and 
(a,t,x)  e  AnxQT, 

(1.4)  l  ||  9  .aa(t,x)i|  ♦  l  ||  9  9  oa(t,x)||  +  £  ||  9  ba(t  ,x)  || 

l<i<d  A  l<i ,  j  <d  J  l<i<d 

+  1  ||  3  3  ba(t,x)  ||+  |9  oa(t,x)|  +  |3  b“(t,x)|  <  k  (1+  |x|)m. 

l<i, j<d  1  J  r  r  n 

Let  1  s  \j  < d  and  let  us  assume  that  (d,d)  matrix  a  in  Equation  (1.1)  is 
written  as  follows: 


(1.5)  a  (t,x)  = 


'^(t.x)  0\  }  v 


0  }  d-V 


v  d-V 


where  a  is  a  (v,v)  matrix  such  that  for  all  (t.x)  *  Qt  and  le  Rv  such  that 

II  Cll  =  l. 


(1.6)  sup  na(t,x)(C,aa(t,x)oc‘(t,x)*J:)  >  0,  where 


na(t,x)  =  (1  +  tr.aa(t,x)  +  |ba(t,xl  |  +  ca(t,x)  ♦  If01  (t.x)  |  f1 


The  definition  of  strategy  is  the  same  as  one  given  in  [5]. 


De  f  ini  t  ion  1.1  Let  n  >  1.  We  write  a*  #1^  if  the  process  a  ~  (oc^.  (gj)  ) , 

0<t<T,  is  defined  on  a  probability  space  (fi.F.P;  F  l  satisfying  the  usual 

conditions ,  which  are  progressively  measurable  with  resvect  to  {F^},  having 

values  in  An>  Le.t  Oi  =  U  n .  The  elements  of  a  set  21  are  called  etra- 

n  -1 

tegies. 


From  the  assumption  (A.l),  it  is  well-known  that  for  each  strategy 


a  e  and  (s.x)eQy,  there  exists  a  unique  solution  of  Equation  (1.1) 
and  we  denote  it  by  (X^’S,X).  Remark  that  in  this  case  it  holds  that  for 
each  a  e  Ql  ,  (s,x)  €  [0,T], 


(1.7) 


E[  sup  |X“’S’X|P]  < 
0<t<T-s 


for  all  p  >  1 . 


Next,  for  each  ac  Ql  and  (s,x)  e  Q^,,  define  a  function  va  by  the  formula: 


T-s  -<)>a’S,X  „ 

(1.8)  v\s,x )  =  E [/  e  £  f(a  ,s+t,X^,S,X)dt  +  e  T'S  g(X  ’®’X)], 

0 


^a.s.x 

T-s  ,va,s,x. 


where 


(1.9)  <>S>X  -  /c(a  ,  s+r,  X°/ ’ x) dr , 

0 


Ot  S  X 

and  (X  ’  ’  )  is  the  solution  of  Equation  (1.1)  associated  with  (a.s.x).  Here 
we  assume  that  the  coefficients  c,  f  and  g  satisfy  the  following  conditions. 


(A. 2)  r c  and  f:  A  *  QT  R,  c  >0, 


We  assume  that  all  of  these  functions  are  bounded  from  below  and  also 
continuous  with  respect  to  (a,t,x).  Assume  further  that  for  each  a,  c  , 
f%c  ’  (Qj)  .  and  g  €  c  (R°)  and  that  the  foregoing  functions  and  all  their 
derivatives  satisfy  the  following  conditions:  9tc,  9^c(l  <i  <  d) ,  9^9jC(l<i , j<d) 
g,  9^g(l  si  <d)  and  9^  9j g  (1  <  i,j  <  d)  are  uniformly  bounded  with  respect 
to  (a,  t , x)  ?  A  x  q  Moreover,  assume  that  for  all  nM,  (a,t  ,x)  «  A^  *  Q^, 


(1.10)  |f(a,t,x)|  +  |9tf(a,t,x)|  +  | f (o,t,x) |  ♦  I ff£^  ( £)(a,t,x)  | 


c  (t.x)  <  kn(i  +|x|)m, 


4- 


1.4 


where  and  f ^  mean  the  first  and  the  second  derivatives  of  fa(t,x) 

along  spatial  direction  £ e  respectively  (see  [5]  p.  46).  □ 

For  each  n,  define  a  function  v  by  the  formula: 

n  1 

(1.11)  v  (s,x)  =  inf  va(s,x) 

a£<Un 

and  also  v  is  defined  by 

(1.12)  v(s,x)  =  inf  va(s,x) 

ae?U 

It  is  easy  to  show  by  the  assumptions  (A.l)  and  (A. 2)  that  the  functions 
v^  and  v  are  locally  bounded  over  Q^.  In  fact,  it  holds  that  there  exist  a 
constant  N  and  a  sequence  of  nonnegative  constants  k^,  n>  1,  such  that  for 
each  n 

(1.13)  N  <  vn(s,x)  <  k;(l  +  |x|)m, 
and 

(1.14)  N<  v(s,x)  <  k’(l  ♦  |  x  |  )m 

for  all  (s,x)  eQT,  because  v(s,x)  S v^ (s,x)  for  V  (s,x)  e  Q^. 

For  further  discussions,  let  us  assume  the  following  conditions  about 
the  coefficients: 

(A. 3)  (1.15)  ca(t,x)  >  28||  Vxa“(t,x)  |]  2  ♦  8 1  Vxba  (t .,x)  |  «■  |  ^(t  ,x)  | 2 

for  all  (a,t,x)  e  A  * Q,p,  where  V^aa  =  (3^  oa . 3^aa) ,  etc.  Moreover, 

12  — 

assume  that  there  is  a  nonnegative  function  u,  belonging  to  c  ’  (Q^) ,  such 
that 

If^t.x)!2  +  l  |3  ^(t.x)!2  +  j  3  f01  (t  ,x)  |  2 
i=l 


(1.16) 


1.5 


+  (9  ba(t,x)|2  ♦  |3aa(t,x)j2  ♦  l  |3  3  fa(t,x) |2 

1  i,j=l  J 

d  d 

+  l  |3.3.ba(t,x)|4+  l  |3  3  aa(t,x)|4  <  -la’£u(t,x), 

ij  =  l  3  i  >  j  =  l  3 

for  all  (a,t,x)  e  A*  Q^,  0<e<l,  where  L  ’  is  a  second  order  differential 

operator  given  by 

.  \J  d  2 

(1.17)  La,eu(t,x)  =  3  u  +  4  l  a“  (t,x)3.3.u  +  zl/2  £  3  u 

t  2  i,j  =  l  ij  1  3  i-'J*l  1 

d 

+  'i  ba(t,x)3.u  -  ca(t,x)u, 
i=l  1  1 

where  a  =  a  a*  . 

Finally,  for  technical  reasons  we  assume  that  there  exists  a  constant  n 
such  that  for  all  aeA,  xeR  and  £e  [0,1], 

(1.18)  f“(T,x)  +  i.a‘eg(T,x)  >  n.  □ 

Some  examples  in  which  the  assumptions  (A.l),  (A. 2)  and  (A. 3)  can  be 
easily  verified  will  be  given  in  Section  3  later.  In  Section  3,  we  shall 
also  discuss  another  assumption  different  from  the  preceding  one. 

Under  the  assumptions  (A.l),  (A. 2)  and  (A. 3)  in  which  e  =  0,  we  have 
the  following  result  about  v^  and  v. 

Proposition  1.1  (a)  v^  is  locally  bounded  in  Q^,  uniformly  with  respeot 

to  n.  (b)  {v  ,  n >  1 }  is  equicontinuous  in  each  cylinder  Q_  D  =  [0,T] 

n  I  y  k 

x  {xe  Rd;  | x |  <R}.  (c)  lim  v  (s,x)  =  v(s,x)  uniformly  in  each  cylinder 

n-*»  n 

Qt  d.  (d)  v  is  absolutely  continuous  in  (s,x);  hence  there  exist  first 
order  generalized  derivatives  with  respect  to  (s,x):  3v/3s  and  3v/3x^, 

1  <  i  <  d,  and,  furthermore,  the  foregoing  derivatives  are  bounded  in  each 


1.6 


Qt  (e)  Tnere  exist  second,  order  generalized  derivatives:  <$~v/dx.dx. , 

1 » K  1  j 

1  < i,j  < v,  whioh  are  also  bounded  in  each  Q_  D •  (f)  It  holds  that 

1  ,K 

(1-19)  inf  Fa[v] (s,x)  >0  a.e.  (s,x)  €  Q  , 

aeA  1 

where  Fa[v]  is  given  by  the  formula: 

(1.20)  Fa[v](s,x)  =  3  v  4  l  a?. (s,x)3. 3.v  +  f  ba(s,x)3.v  -  ca(s,x)v 

-  ijj=1  il  1  3  1  1 


+  f^Cs.x) . 


Proof  The  method  is  the  same  as  [3]  (Proposition  S.l).  (a)  is  clear 

a  l  "> 

from  the  definition  of  v^.  Let  us  prove  (b) .  Since  for  each  cifil,  v  i  c  ’"(Q  ) 
n  c(Q^,)  under  the  assumptions  (A.l)  ~  (A.  3),  we  have  the  following: 

y  s  , s , x  ^ 

(1.21)  3va(s,x)/3x  =  E  [  /  e  *  £  3 .  f  (ot  ,  s  +  t  ,x“,S  ,x)  3.Xa,S,xdt 

i  0  j=l  J  1  1  1  t>3 

Ot  S  X 

+  /  e  ^  f(»  ,s+t,x“’S,X){-/  [3  c(a  s+r,x“-S'X)3  x4’X  dr}dt 

o  L  r  n  ;  J  r  r  1  r’J 


.  a ,  s ,  x 


a ,  s  ,  x 


T-s’^Vt-sJ  x  e  0T'S  +  ^-g(XT-J’X)e  ^ T_S 


-  I  a-g(x4  ’X)  3.x4!*X  x  e 

j  J  1  s  1  *-^»J 


T-s  4 

*  /  1  3  • c  (at  >s+t  ,X^’ s  ’  x)dt]  =  l  4’S,X,  where  is  given  by 

0j  ]  C  1  k=l  K  1 


(1.22)  ip  ’  ’  =  / c(a  ,s+r,X  ’  ’  )dr,  and,  in  addition, 

0  r 


3  f(a,t,x)  =  3f (a,t,x)/3x. ,  3.x“’s,x  =  3x“’S,x/3x. ,  etc. 

J  J  ^  t  f  1  ^  ,  J  1 


In  order  to  get  the  assertion  (b) ,  it  is  sufficient  to  show  that  for  any 
n  >1,  for  all  (a,s,x)  xQj»  3va/3x^  is  locally  bounded  uniformly  with  re¬ 
spect  to  (ot,n).  Using  Schwartz's  inequality  to  I*’S,X,  the  first  term  of 


T 


1  . 


the  right  hand  side  of  (1.21),  we  have  the  following  inequality: 

(1.23)  |l'fr’sE[J  e  £  l\Z  f(a  ,s+t,X'J )  |2dt  | 

1  n  ^  J  L  L 

.a 


T-s  -<t> 

/ 

0  J 

^Ct  .  2 


e[T/  e  4>t  Eiajcj  -|2dt]  S  l“  x  l 
0  j  1  t,J  b 


(we  omit  superindices  (s,x)  so  long  as  they  are  fixed). 

12  — 

Now,  by  means  of  (A.  3),  there  exists  a  nonnegative  function  ue  c  ’ ‘'(Q^.), 
satisfying  (1.16).  Put  u(t,x)  =  u(s+t,x),  0<tsT-s,  (s,x)eQ^,,  then  from 
Ito's  formula,  we  have  the  following: 


~^T-s~ 


T-s  -<p 


a 


(1.24)  e  r_Su(T-s,x“_s)  -  u(0,x)  =  J  e  ‘{3^(1, X®) 


T  I  a“(snjJ)3  3^(t,^Iby,x;)3  2(t,,\Vca(s*t,x“) 

"  i , j=l  J  J  i=l  1  11  r  1 

x  u(t,X^))dt  +  M£,  where  M  is  a  square  integrable  martingale. 

-4a 

Note  that  the  right  side  of  (1.24)  is  equal  to  Se  tL°ttu(s  +  t  ,Xa)  *  dt  +  M  , 

T-s  t  Z 

because  of  the  definition  of  u.  If  we  add  the  quantity  /  e 
^  1 9j  ^(s  +  t  ,X^)  |  “"dt  to  both  terms  of  (1.24),  and  if  we  take  the  mathemati¬ 
cal  expectation,  then,  taking  account  of  the  inequality  (1.16),  we  have  the 
inequality: 

-4>a’s’x 

(1.25)  Ij’S,X  -  E[-e  T_s  u(T,x“’^,X)  +  u(s,x)]  <  u(s,x) , 


for  all  a e  St  ,  (s,t)  e  Q^,  since  u  is  nonnegative. 

On  the  other  hand,  as  to  I,,  since  X^  is  (LB  -  )  differentiable  with  re¬ 
ft  t 

spect  to  x,  we  have  the  formula: 

t 


3.X®  .  *  6..  +  /  l  3.  ba(s+r,xa)3.xa  ,  dr 
i  t.j  ij  i  t  k  J  T  i  r’k 


0  k 

+  /  l  3£°ikCs+r*Xr)3iX?  £dBk(r) 
0  k,f>  1  JK  r  l  r , v.  k 


(1.26) 


1  .8 


(see  [5],  Chapter  2,  Section  8).  By  using  again  Ito's  formula  (and  also 
taking  the  mathematical  expectation),  we  get  the  following: 

.a 


(1.27)  l  E[e  tOix“  }2]  =  6  +  [  E[/-e  '  r{9  x“  .}^c“dr 

i,j  -  i , j  0 

*  l  Vr>J  I  *  l  l 


t  -<j> 


rr„  va  ,2  a. 


<  *N(1+E[/  e  r{-c“+ 2|Vba(r)  1  +  ||  Vaa(r)  ||  IVX^dr)) , 

rt  r  t* 


where  |Vba(r)|“  =  £  1 3ib^‘ (r)  | 2,  j|  Vaa(r)  |j  2  =  l  |  3  a“ ,(r)|2 

i.j  J  i,j,k  J 

and  |VXa|2  =  J  | 3 . Xa  . |2  . 

r 1  .  L  .  1  i  r, l  1 

Then,  on  account  of  (A. 3)  (1.1S),  we  have  the  inequality: 

-4>a,s’x 

(1.28)  l  E[e  t  (3  X°t’^’x}“]  <  ^N,  for  all  (a,s,x,t)  6  f  x  Q  *  [0,T-s], 
i,j  1  1 


where  N  is  a  nonnegative  constant  independent  of  (a,s,x,t).  Therefore,  from 

(1.25)  and  (1.28),  we  can  conclude  that  there  exists  a  nonnegative  function 
~  ~  12— 

u  over  such  that  uec  ’“(Q^)  and  for  all  n,(a,s,x)e  x  Q^, 

(1.29)  | l“’S ,X|  s  u(s,x). 


For  the  other  I ^ ’ s  (k=2,3  or  4),  we  can  also  obtain  the  same  kind  of  estimates 

(1.29)  for  1^.  by  using  the  assumption  (A. 3).  Thus  it  is  shown  that  there  exists 
a  nonnegative  function  u'  e  c  ’“(Q^,)  such  that  for  all  (a,s,x)  e  SJ-xQ^,, 

d 

(1.30)  l  | 3va(s , x)/3x. |  s  u'(s,x). 

i=l  1 


Similarly,  it  is  not  hard  to  see  that  3v  /9s  is  also  locally  bounded  uni- 


formly  with  respect  to  a  by  using  (A. 3)  and  (1.28).  The  assertions  (c) 
can  be  obtained  by  the  sane  way  as  [3]  (Proposition  5.1). 


2.1 


2.  NORMbH  BELLMAN  (EQUATION 

As  it  is  well-known  (see  Section  5  and  also  [5],  6.3.14,  p.  273),  gener¬ 
ally  the  inverse  relation  of  (1.19)  does  not  hold  if  the  coefficients  are  not 
bounded  with  respect  to  a.  Therefore,  in  fact,  we  need  to  introduce  some  aux¬ 
iliary  notations.  Let  m  (t,x)  be  a  nonnegative  function  with  respect  to 
(a,t ,x)  e  A  * Q_,  and  define  Gm  by  the  formula; 

(2.1)  Gm(u  ,u  ,u  ,u,t,x)  =  inf  ma(t,x){u  + i  l  aa.(t,x)u 

J  CteA  “l<i,j<v  ' 

+  l  b“(t,x)u  -  ca(t,x)u  +  ^(t.x)}  (a  =  a  a*  ) 

l<isd  1  1 

Definition  2. 1  A  nonnegative  function  ma(t,x)  over  A  x  is  said  to  be  a 
normalizing  multiplier  if  for  all  uQ,  u^  ,  u.  ,  u,  t,  x, 

(2.2)  Gm(u0,ui^.  ,ui  ,u,t,x)  >  -<*. 

Moreover,  the  normalizing  multiplier  ma(t,x)  is  called  regular  if  there  exists 
a  function  N(t,x)  <  00  such  that  for  all  (a.t.x)  •:  A«  QT> 

(2.3)  m®(t,x)  <  N(t,x)ma(t ,x) , 

-  •  ot  . 

where  tne  funciaon  mQ  is  given  by  the  formula: 

(2.4)  m^(t,x)  =  {I+7  I  !  a?.  ( t ,  x )  |  “  +  l  |b“(t,x)|“ 

1 < i , j  <v  J  i=l 

+  |cCt(t,x)|‘  J  f0  (t ,  x)  |  “ } _ls  .  J 

Let  us  assume  the  conditions  (A. 1 ) ~  (A. 3).  Then  we  have  the  following 
main  result. 


Let  m  (t,x)  be  a  regular  normalizing  multiplier.  Then  it  holds 


that 


(2.5) 


Gm[v] (t ,x)  =0  a.e.  (QT) , 

-te  Gn[v)(t,x)  =  Gm(3tv,  3.3  v,  3iv,v.t.x).  □ 

We  call  (2.5)  the  normed  Bellman  equation.  For  the  same  reason  as  [3], 
Section  5  (see  also  [5],  pp.  269~271),  in  order  to  prove  (2.5),  it  is  suf¬ 
ficient  to  show  the  following: 

Lemma  2. 2  If  ma(t,x)  =  m^t.x),  then  (2.S)  is  correct.  f 

This  can  be  shown  by  the  same  way  as  [3],  Section  5,  the  so-called  per¬ 
turbation  method.  Since  the  proof  is  almost  the  same  as  [3],  it  is  suffici¬ 

ent  to  describe  different  points  from  it.  Let  us  start  introducing  several 
notations  as  usual.  Let  e  be  an  arbitrary  number  between  0  and  1,  and  for 
each  e,  (a,s,x)£  AxQ^,  define  a  by  the  formula: 

(2.6)  'At.x)  0 

a£(a,t,x)  =  e  0 

,0  0  e 

V  d-V 

For  each  ae  51  ,  (s,x)  e  Q^,  0<  e<  1,  let  (x^’s,x,E:)  be  a  solution  of  Equa- 

£  a  e 

tion  (1.1)  in  which  a  is  replaced  by  o  ,  and  also  let  v  ’  be  given  by  (1.8) 

in  which  (X^’S'X)  is  replaced  by  (x^’s,x,cj  .  For  each  0<  e<  1  and  n>  1, 

define  v£  and  ve  bv  the  formulas: 
n 

(2-7)  (V'(s.x)  =  inf  va,e(s,x),  and 

v£(s,x)  =  inf  v£(s,x) . 
n>l 


}  v 
}  d-v 


Then  we  have  the  following: 


Proposition  2.3  (a)  is  uniformly  (in  (e,n))  bounded  and  also  equicontin- 

uous  in  (s,x)  uniformly  with  respect  to  e  in  each  cylinder  0  .  (b)  For 

'T ,  R 

£  £  _  p 

each  e>0,  lim  v  (s,x)  =  v  (s,x)  uniformly  in  each  Q  ,  and  v  is  continuous 
n  T ,  K 

n-»o 

in  (s,x) e  Q  .  (c)  For  each  £>0,  n>l,  v££W^’“(Q)  and  v£  e  W1  ’  ^(Q)  (cf.  Sec- 

T  n  p  x  p 

tion  4)  for  any  bounded  subregion  QcQ^,  p>  1.  Moreover,  all  their  first  or¬ 
der  generalized  derivatives  with  respect  to  s  and  x^ ,  1<  i<d,  and  second  or¬ 
der  generalized  derivatives  with  respect  to  x^xj  >  1-  i»j-  v  ax>e  locally 

bounded  in  Q  uniformly  with  resvect  to  (e,n).  (d)  lim  v£(s,x)  =  v(s,x), 

e-K) 

uniformly  in  each  cylinder  Q  .  □ 

Proof.  Since  the  assertions  (a) ~  (e)  are  the  same  as  [3]  (Proposition  5.4) 
it  is  sufficient  to  show  (d) .  Consider  the  following  equality: 

(2.8)  v£(s,x)  -  v(s,x)  =  (v£(s, x)  -  v£(s,x) )  +  (vE(s,x)  -  v^fs.x)} 


{ v  ( s , x)  -  v  (s ,  x) }  -  i",E  +  I1)’0  +  i" 
n  l  2.  o 


Note  that  for  each  £>  0,  lim  1^’  =0  by  means  of  (b)  above  and  also  that 

n-*» 

lim  i!!  =  0  from  (c)  of  Proposition  1.1.  Note  also  that  the  convergence 
n-*»  0  _ 

is  uniform  in  each  cylinder  Q„  D  in  both  cases.  Let  us  show  that  I.,’  -*•  0 

1  >  K  2. 


as  e  -*■  0  uniformly  with  respect  to  n. 


_  Q  0 

For  each  a  e  21  >  0  <  £  <  1 ,  (s  ,x)  e  Q^,  v  ’  (s  ,x)  is  written  as  fol  lows : 


.a,s,x,£ 


.a,s,x,£ 


(2.9)  va’e(s,x)  =  E[  J  e  1  f (at>s+t,x“>S’x’fdt +  e  T‘s  g(x“’®’x’e)] 


It  is  easily  shown  that  for  each  (ot,s,x)  ,va,£  is  continuously  differentiable 

Ot  £ 

with  respect  to  £,  and,  moreover,  9v  ’  /9e  is  given  by  the  following:  (we 
omit  also  the  superindices  (s,x))  (see  [5],  Section  2.8). 


T-s  t  d  -<{>  ’ 

r  f  !  _  f  V  a  ^  _ 


(2.10)  9v  ’  /9e  =  E[/  (-/  l  3.c  ■ ’  9Xa,e/9£-dr}e  t  f  ’  dt 

0  0  i=l  1  r’1 


2.4 


Then,  by  using  the  Ito  formula,  taking  account  of  the  condition 
(A. 2),  we  have  the  following:  there  exists  a  nonnegative  constant  N,  inde¬ 
pendent  of  (a,s,x  e) ,  such  that 
^a,s,x,e  d 

(2.12)  E[e  t  l  |3x“’S,X,>73en  *  N, 

i=l 

(see  also  (1.26) ~  (1.28))  . 

Ot  0 

As  we  saw  in  Section  1,  since  it  is  not  difficult  to  estimate  3v  ’  /3e 
by  using  (A. 3)  and  also  the  inequality  (2.12)  just  as  we  proved  above,  it 
holds  that  there  exists  a  nonnegative  function  u'  over  such  that  u'  is 
locally  bounded,  independent  of  (a,e)  and 

(2.13)  | 3va,£(s,x)/3e|  <  u'(s,x) 

for  all  (a,s,x,e)  e  8JI  x  q  x  (0,1).  Now  it  is  clear  from  the  above  inequal¬ 
ity  that 


(2-14)  lv„Cs,x)  -  v  (s,x) I  =  I  inf  va,£(s,x)  -  inf  va[s,x)| 

ae»n 

<  sup  jv  (s,x)  -  V  (s,x)  I  <  sup|v  (s,x)  -  v  (s,x) I 

aeSI  ae8{. 

n 

=  sup  |  J{3va’  ^£(s ,x)/3e}edX |  <  e*u'(s,x), 
aegj  0 

which  implies  that  I^’£-*-0  as  e  0  uniformly  with  respect  to  n  (we  used 
Hadamard's  theorem)  .  l> 

Recall  the  definition  (2.1)  of  Gm,  and  for  each  n=l,2,...,  denote  bv  Gm 

n 

the  right  side  of  (2.1)  if  we  replace  A  by  A  .  In  addition  to  these  no¬ 
tations  we  further  need  the  following  one:  for  each  function  m  and  c.  e  (0,1), 
define  Gm,£  by  the  formula 

(2.15)  Gm,e(u  ,u  ,u  ,u,s,x)  =  inf  nia(s,x){u  +  (j)  l  aa  (s,x)u.. 

u  1J  1  ae  A  u  1  l<i,j<v  1J  1J 

,  d  d 

+  (e4/ 2)  l  u..  «•  l  b?(s , x) u  -  c  (s,x)u  +  t  (s,x)}. 
i=v+l  i=l 

Then  we  can  obtain  the  following,  where  proof  is  the  same  as  [3]  (Lemma  5.5). 

Lemma  2 . 4  For  each  e>  0  it  holds  that 

m0’£  £  V£  £  £  £  £ 

(2.16)  G  u  [v  ](s,x)  =  G  u  Otvt',  3.3. v ",  3.  v£ ,  v  ,s,x)  =  0 

a.e.  (Qt) .  Q 

Let  £  +  0  in  (2.16).  In  order  to  show  Lemma  2.2,  we  also  need  the  follow¬ 
ing  transformation  of  variables:  let  us  fix  an  arbitrary  pair  (£,£)  such  that 
£  =  (Cv+i» • • • >5^)  e  V  and  0  <  £  <  1 ,  and  define  new  variables  (s ,y) e  in 
the  following  way: 


2.6 


(2.17) 


v.  =  x.  ,  is  is  v 
■  1  i 

ey.  =  x.  -£.,v+i<i<d 
i  i  i 


For  any  ye  R  ,  let  y  and  y  denote  the  first  v  and  the  last  d-  v  components 
of  y  respectively  (similar  to  x=  (x,x)).  Then  the  last  two  expressions  of 
(2.17)  are  written  by  y=  x  and  ey =  x-  £  respectively.  For  each  (£,e),  define 
a  function  ^ over  bv 


(2.18) 


^’e(s,y)  =  v"(s,x)(=  ve(s,y,ey  +  £))  . 


If  we  assume  the  conditions  (A.1)~(A.5).  it  is  not  hard  to  show  that  < p'” 
has  the  following  properties. 

Lernia  2.5  (a)  For  each  (?,e),  vp'" ’ e  e  W*’“  (Q^)  for  any  p>  1.  (b)  The 

function  itself  and  its  jeneralized  derivatives  'j^,e(l£  i<d), 

c  £  ^  ’  i 

’  (’  <  i,j  <  d),  are  locally  bounded  in  each  cylinder  Q  uniformly  with 

•  1  .1  _  r  _  _  -  d 

revsect  to  e.  (a)  For  any  (s,v)  €  Q  ,  lim  ij/”£(s,y)  =  v(s,y,£)  (y =  (y,y)  e  R  ), 

e-H) 

whose  convergence  is  uniform  in  each  cylinder  Q  ■  □ 

Since  the  proof  is  the  same  as  [3],  we  omit  it  here. 

Proof  of  Lemma  2.2  Now,  in  order  to  prove  Lemma  2.2,  it  is  sufficient  to 
m 

show  that  G  [v](s,x)<0  a.e.,  due  to  Proposition  1.1  (1.19).  At  first,  it 
is  easily  seen  that  Equation  (2.16)  is  equivalent  to  the  following: 

(2.19)  0  =  mf  m  (s,y){ip’’  +  —  \  a  (s,y)i|r*v 

aeA  “  l<i, j<v  •  i"  j 


2  l  K  V  +  x  (S,y)  -  C  ,s’  (S,y)v  >  a.e.  (Q  ) , 
i=v+l  yiyi  1 


where  m 


~a,£,e  ~a,C.£  ~a,£,e  ~ol  ,£,e 


,  c  and  x  ’  are  given  by  the  following 


(0<e<l)  respectively: 


(2.20) 


C  n^,‘”e(s,y)  =  m'g(s,y,ey  +  £) ,  y=(y,y), 


~a,£,e,  .  i.  -  A  „ 

a  (s,y)  =  a  (s,y,ey  +  Q, 


c  (s  ,  y)  =■  c  fe.v.ey  +  £)  . 


~a,£,e,  a,  —  ~  r. 

X  (s»y)  =  X  (s.y.ey +  £) , 


(Xa(s,x)  =  l  b^(s,x)vx  (s,x)  +  f^fs.x)) . 


From  (2.19)  we  obtain  the  following  inequality: 
mn  r  2  - 

(2.21)  0  >  G  U[^,E](s,y)  ♦  l  f^e(s,y),  a.e., 

i  =  l 

. 

where  G  ]  and  f?’  (i=l,2)  are  given  by  the  formulas: 


III  _  _  III  r  r  r  K 

f  a  —  ^  0  f  ,  '-y  f  £  ,,  s  >  £  x  •  o  ~Ct  t  f  0  ~  r  .  i  >  £ 

(2.22)  G  ]  (s ,v)  =  u  (^  ,  v  .  'J>  ,s,y)  =  inf  m0”’  (s,y){.  s’ 

'  i'  j  ae  A 

*4)  I  3“;5,0(s, >')(/•';  •  (4)  f  44  -?‘’5’°cs,v)4-£.?,'5’0(s,y)t, 

i,j  =  l  •’  ' v]  "  i=v+l  'i’i 


(2.23) 


f^’£(s,y)  =  inf[^’e(s,y){^’e  +  ±  [  aj^^Cs.y)^ 

X  ■  V/  O  ^  *  i  «  1  I  V  *  f  • 

ae  A  x ,  j  =  1  'ii 


1  r  £,e  ~a,£,0,  ,r,£,£ 

>  K  v  "c  (s.y)'r  }  -  m0  (s,y){^* 

i=v+l  '  i'  i 

+  2  i  ai  (s*y)^v  v  )  Cv  *c  cs*y)r  )], 

i,  j  =  l  13  yiyj  v+1  yiyi 


(2.24) 


f,’Cts,y)  =  inf{m^’^,e(s,y)xCt’f’’C(s,y)  -  n^’^’°(s,y)xCl’^,0(s,y)} 
ae  A 


2 .  S 


Let  {en},  n=l,2,...,  be  a  sequence  of  arbitrary  positive  numbers  such  that 

lim  e  =  0,  then  by  the  same  way  as  [5]  (see  the  proof  of  Lemma  5.3)  we  can 

n  p* 

show  that  for  a.e.  R  ,  lim  n(s,y)  =  0  (i=l,2)  a.e.  in  each  cylinder 

n-+°° 

Q  .  In  fact,  in  this  case  it  is  sufficient  to  check,  for  example,  the  fol- 
T,  K 

lowing  inequality:  there  exists  a  constant  N  (£)  which  depends  upon  (R,£) 

K 

such  that 

A  A 

(2.25)  [  .  (s,y,  ey  +  £)  -  a^(s,y,C)|  <  e  :NR(£)  {ca(s,y,ey  +  £)  +  1),  for  all 

ae  A,  (s,v)  e  QTR>  C  e  Rd  V  and  0<  e  <  1, 
because  of  the  assumptions  (A. 2)  and  (A. 3)  (in  fact,  (1.15)).  We  can  also 


make  similar  estimates  for  b,  c  and  f  as  in  (2.25).  On  account  of  the  above 

e  _  _ 

estimates  and  the  fact  that  the  equality  lim|Vv  n(s,y,e  y +  5)  -  Vv(s ,v ,£) |  =  0 

still  holds  in  this  case,  it  is  shown  that  lim  f.  n(s,v)=  0  (i=l,2),  whose 

n-*»  1 

proof  is  routine  and  thus  omitted  here. 

Finally,  for  the  same  reason  as  [3],  we  can  obtain  the  following  inequal¬ 
ity:  for  a.e.  f , 


~C.E 

m0  nr,C,en 


~m0  £ 


(2.26)  0  2  lim  G  [ iT*  ](s,y)  ^  G  u[^](s,y)  a.e.  (s,y), 

n-*00 


where  r’(s,y)  =  v(s,y,C)  . 

J»0  f  mn  _ 

But,  since  G  [v’](s,y)  =  G  [v](s,y,£),  (2.26)  implies  the  desired  relation: 


(2.27) 


>  G  [v](s,x)  a.e.  (Q.f) 


□ 


5.1 


3.  EXAMPLES  AND  APPLICATIONS 


5.1.  Here  we  shall  discuss  another  assumption  different  from  (A.l), 

(A. 2)  and  (A. 3)  in  Section  1.  Roughly  speaking,  the  latter  is  the  most 
general  one  in  the  case  in  which  all  of  the  coefficients  are  unbounded  rela¬ 
tive  to  the  parameter  a.  We  can,  however,  relax  the  assumptions  with  respect 
to  the  coefficients  f  and  g  if  the  bounds  of  a  and  b  are  independent  of  a, 
which  is  often  important  from  the  point  of  view  of  applications.  Let  us  con¬ 
sider  the  following  example. 

Let  us  assume  that  a  and  b  satisfy  the  following  conditions: 

(A.l) '  .  a:  A  — ►  Rd  ®  Rd 

.  b :  A  x  R^ 

.a  is  a  continuous  ft.  in  A  and  b  is  also  continuous  in  (a,t,x). 
b  is  uniform  Lipshitz  continuous  with  respect  to  x,  i.e.  there 
exists  a  nonnegative  constant  k  such  that 

(5.1)  |b(a,t,x)  -  b(a,t,x' )  |  <kjx-x'| 

?d 

for  all  (t,x,x',a)  e  [0,T]  x  R“  *  A,  and  also 

(5.2)  ||  o(a)  ||  +  |b(a,t,x)  |  £  k(l  +  |x|) 


for  all  ot €  A,  (t,x)  €  Q^. 


Furthermore,  for  each  ae  A,  b^e  c1,2(QT)  and  its  first  order  deriva¬ 
tives  with  respect  to  (t,x),  S^b,  9^b(l<  i <  d)  and  second  order  one 

Ct 

9^3jb( i<i, j<d)  are  uniformly  bounded,  a  is  still  assumed  to  satisfy  the 
relations  (1.5)  and  (1.6).  0 


As  for  c,  f  and  g,  assume  the  following  conditions: 


3.2 


(A . 2 ) '  c :  A  R , 

f:  A  x  Q T  R ,  g:  Rd  —  R. 

c,  f  and  g  are  continuous  functions  over  A,  A  * Q^,  and  Rd  respectively,  c  is 
nonnegative  and  f  is  also  uniformly  bounded  from  below.  Moreover,  for  each 
a  £  A,  f0tec1’4’(QT)  and  there  exists  a  nonnegative  sequence  {k^}  n>0  such 
that  for  each  n  =  1,2,..., 


_  2d 

for  all  (a, t ,x)  e  A^ x Q  As  to  g,  g ?  c  (R  )  and  it  satisfies  the  following 
condition:  for  all  >.  e  Rd, 

d  d 

(3-4)  |g(x) |  +  l  |3.g(x) I  ♦  l  1 3 .3.g(x) |  <  Kf 1  +  | x | )m, 
i=l  i,j=l  1  1 

where  m  is  a  nonnegative  constant.  □ 


In  this  case,  we  assume  the  following  condition  instead  of  (A. 3): 


_  1  ?  _ 

(A. 5)'  There  exists  a  nonnegtaive  function  u  over  QT  such  that  U(c  ’  (Q  ) 
and,  moreover , 

d  d 

(5.5)  | f (a,t,x) |  +  | 3  f (a,t,x)  +  £  !3.f(a,t.x)|  +  £  | 3. 3 . f (a, t , x) | 

i-1  ij  =  l  1  J 

♦  la,Cu(t,x)  <  0 


for  all  (a,t,x)  e  A*Q^,,  0<e<l,  where  La,eis  given  in  (1.17).  Assume 

further  the  following  condition  between  f  and  c: 
d 

(3.6)  l  | 3. f (a.t ,x) !  <  kc(a) , 

i  =  l 

for  all  (o,t,x)  e  A  *  Q^..  Finally,  we  also  assume  the  same  condition  as  (1.8), 

i .  e. 


^ .  .5 


(3.7)  f“(T.x)  ♦  /.a,E g(T,x)  >  n 

for  all  (a,t,x)  e  A  *  and  all  e  €  [0,1).  D 

Then  we  have  the  following  result  whose  proof  is  the  same  as  Theorem  2.1. 

Theorem  3. 1  Assume  the  conditions  (A.l)'~  (A. 3)’.  Then  the  assertion  of 
Theorem  2.1  is  correct.  n 

Remark  5 . 1  Thus  we  can  consider  ether  assumptions  besides  (A.1)~(A.3) 
or  (A. 1) '  ~  (A. 3) '  under  which  Theorem  2. 1  holds  (e.g.  in  (A. 1) '  ~  (A. 3)  ' ,  if 
g  has  bounded  derivatives  then  the  conditions  with  respect  to  b  can  be  re¬ 
laxed,  etc.)  (cf.  [3]  examples  5.1,  5.2).  0 

Before  we  consider  an  example  for  which  the  assumptions  (A.l)'~  (A. 3)' 
hold,  notice  the  following  fact. 

Ct  _ 

Remark  3.2  In  order  that  m  (t,x)  =  1  (constant  function)  is  a  normalizing 
multiplier,  it  is  sufficent  and  necessary  that  for  any  r>0,  (t,x)  e  Q  , 

(5.8)  inf{-r[^  tr.aa(t,x)  +  |ba(t,x)|  +  ca(t,x)]  +  fa(t,x)}  >  -°° 
aeA 

This  is  a  small  modification  of  the  result  due  to  N.  V.  Krylov  ([5],  Exer¬ 
cise  6.5. 10) .  □ 

3.2  Consider  the  following  simple  example  considered  by  N.  V.  Krylov  in 
the  case  of  d  =  1. 

(3.9)  inf  O  v  +  i  v  -av  +  af(t,x,y)}  =  0, 

0<a«»  " 

~  12  — 

where  f  is  a  bounded  and  c  ’  (Q^)  function  with  bounded  derivatives.  It  is 
easily  seen  that  the  coefficients  of  Equation  (3.9)  satisfy  the  assumptions 
(A.  1) '  ~  (A.  3)  ’  (d=  2,  v=  1,  A  =  (0 ,°°) ,  Ca(t,x)  =  (J  j}),  ba(t,x)  S  0,  ca(t,x)  -o. 


3.4 


2  ct  ~ 

(x,y)  £  R  ,  f  (t,x,y)  =  af(t,x,y),  g  is  arbitrary,  but  also  note  that  the 
constant  function  1  is  not  normalizing  multiplier  for  any  such  f  by  means 
of  (3.8).  Therefore,  we  could  not  know  whether  the  cost  v,  given  by  (1.12), 
satisfies  Equation  (0.1)  and,  in  fact,  there  exists  a  counter  example  (cf. 
[5] ,  Example  6.3.14) . 

For  0<a<°°,  (t,x)  £  QT>  put 

(3.10)  ma(t,x)  =  , 

then  it  is  easy  to  verify  that  the  function  ma  is  a  normalizing  multiplier 
of  Equation  (3.9).  It  follows  from  Theorem  3.1  that  v  of  (1.12)  is  a  gen¬ 
eralized  solution  of  the  following  normed  Bellman  equation: 

(3.11)  inf  ma(t,x)  {3  v+ i  v  '  av  + otf(t,x,y)  }  =  0,  v(T,x)Hg(x). 

0<a<®  “ 

If  we  put  8  =  >  then  Equation  (3.11)  is  equal  to  the  following  one: 

(3.12)  inf  {(1  -  6) (3  v  ♦  y  v  )  ♦  6(f(t,x,y)  -  v) }  =  0. 

Os  s<  1 

But  it  is  equivalent  to  the  following  inequalities: 


(3.13) 

j  (a) 

f(t,x,y)  =  v(t ,x,v) , 

-  1 
3tV+  2 

\ 

(b) 

f(t,x,y)  >  v(t ,x,y) , 

V  2 

3.5  Linear  case  (separate  form  of  variables) 

If  all  of  the  coefficients  are  of  separate  form  in  the  variables 

(t,x)  and  at,  then  the  assumptions  (A.1)~(A.3)  can  be  verified  easily  in 

the  following  way. 

6  — 

Let  A  =  R  (ez  1),  and  assume  that  o,  b,  f,  c  and  g  are  of  the  following 
form:  ^(t.x)  =  K(t,x), 


3.5 


o  ba(t,x)  =  I(t,x)  +  J(a),  c^t.x)  =  0, 

o  f01  (. t * x)  =  M(t,x)  +  N(ct) , 

where  K,  I ,  ,  M  and  N  satisfy  the  following  conditions: 

(A. 1)  "  K:  QT  -  RV  a  RV,  I:  QT  —  Rd 

1  X 

0  K  and  I  are  Lipshiti  continuous,  i.e.  there  exists  a  constant 
k  >  0  such  that  for  all  te  [0 , T ] ,  x,x' e  Rd, 

||  K(t,x)  -  K(t,x')  ||  +  1 1 C  t ,  x)  -  I(t,x')|<k|x  -  x  *  |  . 


(A. 3)" 


Corollary  3.2  Assume  (A.l)''~  (A . 3)  *  * ,  then  the  assertion  of  Theorem  2.1 
still  holds.  □ 


Remark  3.3  If  the  function  J  is  null,  then  the  assumptions  will  respect 
to  M  and  g  are  relaxed  (see  Theorem  3.1).  We  can  also  consider  the  case 

where  o  depends  upon  a  under  which  the  assertion  of  Corollary  5.2  is  correct. 

□ 

0 

Remark  5 . 4  Linear  Regulator  Problem:  A  =  R  . 

aa(t)  E  o(t),  ba(t)  =  A(t) x  +  B(t)a, 
f^t.x)  =  xM(t)x*  +  aN(t)a*,  g(x)  =  xDx* 

(M,  N  and  D  are  symmetric  matrices  such  that  M>  0  and  N,D>  0)  is  not  included 
in  (A.l)''~  (A. 3)",  but  it  is  well-known  that  this  problem  can  be  solved 
completely  by  a  particular  method  (see,  for  example,  [2],  p.  165).  □ 

3.4  Consider  the  following  1-dim.  (d=l)  Bellman  equation: 

(3.14)  inf  O^v  +  \v"  +  /2av’  +a“  +  d(t,x)}  =  0, 

-°°<ct<00 

where  A  is  a  positive  constant  and  d  is  a  nonnegative,  bounded  and  continu¬ 
ous  function  of  (t,x) .  It  is  easily  shown  that  this  equation  is  equivalent 
to  the  following: 

(3.15)  3  v  +  Av"  -  --j  -  *  d(t,x)  =  0, 

and,  moreover,  Equation  (3.15)  is  known  as  "equation  of  burning  of  gas  in 
a  rocket"  ([1],  p.  23).  Since  the  coefficients  of  Equation  (3.14)  satisfy 
the  assumptions  (A.l)''~  (A.3)'',  the  cost  v,  given  by  -the  formula 

T-s 

(3.16)  v(s,x)  =  inf  E[  J  {|a  |  +  d(s+t,  X*’x)}dt  +  g(x“’*)], 

-coco^cco  0 

is  a  generalized  (classical  in  this  case)  solution  of  Equation  (3.14)  (and 


Cl  X 

of  Equation  (3.15))  by  means  of  Corollary  3.2.  Here,  (X  ’  )  is  given  by 

t  _ 

(3.17)  x“,x  =  x  +  /  SI  a  dr  +  /Tk  Bt , 

t  o  1 

and  the  function  g  may  be  taken  appropriately  so  as  to  satisfy  (A.2)'' 
and  (A. 3) ' ' . 

By  using  Corollary  3.2,  we  can  easily  extend  the  above  result  to  a  multi¬ 
dimensional  and  also  degenerate  one.  For  example,  assume  that  a  =2,  v=l 

i 

and  A=R“.  Let  us  consider  the  following  degenerate  Bellman  equation: 

(3.18)  inf  Otv +j  vxx+ (a,Vv)  +  |  t|2  +  d(t,x,y)}  =  0, 

then  it  is  easily  shown  that  this  is  equal  to  the  following: 

9  2 

,  (v  )  (v  y 

(3.19)  V  +  I  vxx - f - 2~~  +  d(t.x,y)  =  0. 

Thus,  by  using  Corollary  3.2,  it  is  also  shown  that  the  cost  v  (see  (3.16)) 
is  a  generalized  solution  of  Equation  (3.19),  which  is  a  nonlinear  and  degener¬ 
ate  differential  equation.  We  can  obtain  a  partial  result  if  d  is  not 
bounded  ( [4] ) . 

Remark  3.5  It  is  well-known  (e.g.  [1])  that  certain  kinds  of  equations,  such 
as  Burger's  equation,  are  equal  to  Equation  (3.15)  by  simple  transformations. 
Therefore,  by  means  of  the  above  discussions,  the  cost  v  is  an  explicit  rep¬ 
resentation  of  a  solution  for  those  (nonlinear,  degenerate)  partial  differen¬ 
tial  equations.  Moreover,  by  choosing  the  coefficients  in  Equations  (0.1)  or 
Equation  (2.5)  appropriately,  we  can  consider  many  other  differential  equa¬ 
tions  than  Equation  (3.19).  Conversely,  it  is  well-known  that  the  following 
equation , 

d  d 

l  a. . (t,x)3. 9iu  +  l  b.(t,x)3.u  -  c(t,x)u  =  0 
i » j  =  l  J  i=l 


(3.20)  3tu  +  i 


3.8 


can  be  formally  transferred  to  the  Bellman  equation  by  simple  trans forma 
tions  (for  the  details,  see  [4]). 


4.1 


4.  UNIQUENESS 


There  arises  naturally  a  problem  whether  the  cost  v,  given  by  (1.12), 
is  only  one  solution  of  Equation  (0.1)  or  Equation  (2.5),  i.e.  the  unique¬ 
ness  problem. 

It  is  known  (e.g.  [3],  [5])  that  if  all  of  the  coefficients  in  Equa¬ 
tion  (0.1)  are  bounded  with  respect  to  a,  then  there  exists  only  one  solu¬ 
tion  of  Equation  (0.1)  under  relatively  general  conditions. 

On  the  other  hand,  if  the  coefficients  are  unbounded  with  respect  to 
a,  then  it  is  difficult  to  get  such  general  results  from  Equation  (2.5) 
as  the  preceding  one.  In  the  following,  we  shall  discuss  only  some  parti¬ 
cular  cases  which  were  treated  in  Section  3  (cf.  [3],  Remark  5.2). 


Following  [3],  let  us  start  to  define  additional  notations.  Let  c(Q^,) 
be  a  space  of  real  valued  continuous  functions  defined  over  Q^.  For  each 
v(l<v<d),  p>l,  we  say  that  a  real  valued  function  u  given  on  QT  belongs 
to  wi’?’V(QT)  if  there  exist  generalized  derivatives,  9  u,  9.u  (l<i<d) 
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and  9^9jU  (lsi.j  s  v)  such  that  they  are  locally  p^  integrable  on  Q^.  We 
1 

write  Wp,j0CWji  if  v  =  d  which  is  the  well-known  Sobolev  space. 

Let  ma(t,x)  be  a  regular  normalizing  multiplier. 


Definition  4.1  A  real  valued  function  u  over  is  called  m- superharmonic 
if  'there  exist  constants  p,  X  and  k  >0  such  that  ue  Wp’ioc^T^  n 


(4.1) 


|u(t,x) I  <  k(l  +  |x|)A  , 


and ,  moreover , 


(4.2)  Gm  [u]  (t  ,x)  >  0  a .  e .  (Q?) ,  u(T,x)  <g(x),  x  e  Rd. 


Then  we  have  the  following. 


4.2 


Theorem  4. 1  Let  ma  be  a  regular  normalizing  multiplier  and  let  u  be  m-super- 
harmonic.  Moreover ,  suppose  that  3.u(liiid)  and  3^3jU(l  <  i,j  <  v)  are  local¬ 
ly  bounded.  Then  for  all  (s,x)  e  Q^,  u(s,x)  <  v(s,x),  0 


Proof.  By  means  of  (4.2)  and  the  definition  of  ma 

(4.3)  Fa[u]  (t,x)  >  0  for  a.e.  (Q^) , 

where  Fa[u](t,x)  =  Fa(3tu,  3^u,  3^3. u,  u,t,x)  and  Fa 

(4.4)  Fa(u0,u..,ui,u,t,x)  =uQ  +  y  l  a**.  (t,x)u..  ♦ 

r  *  J  1 


it  follows  that 


(•)  is  given  by  the  formula 
d 

l  b? (t,x)u.  -  c“(t,x)u 
i=l  1 


+  f^t.x) . 


Let  us  fix  a  e  ;  then  there  exists  a  number  n  such  that  ae  SUn»  and  for 
such  a  it  is  well-known  ([3]),  Theorem  3.1)  that 

(4.5)  va(t,x)  >  u(t,x)  for  all  (t,x)  e  Q^.. 

By  means  of  the  definition  of  v,  the  assertion  follows  immediately  from  (4.5). 

I— 
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In  order  to  show  the  inverse  relation,  we  need  a  further  new  notation  and 
also  some  assumptions  about  the  coefficients.  For  any  real  valued  function  h 
on  and  £  e  Rb  such  that  |£|=1,  0  <  <5  <  1 ,  define  the  quadratic  difference, 

DMh(t,x)’  by 

(4.6)  D2  ^h(t,x)  =  (h(t,x  +  6£)  +  h(t,x-5£)  -  2h(t,x)]/6“ 

Note  that  if  h(t,*)  c  c2  (QT)  then  ^h(t  ,x)  -*■  h^  ^  (t  ,x)  as  6  +  0. 

Let  ma(t,x)  be  a  regular  normalizing  multiplier.  Borel  measurable  with  re¬ 
spect  to  (t,x)  and  continuous  with  respect  to  a.  Then  we  have  the  following 
(cf.  [3] ,  Lemma  4.2) . 


Lemma  4. 2 


For  some  p,  let  ue"p’ioc  (Q-j.)  n  c (Q-p)  >  Also,  let  Gm[u](t,x)sO 
a.e.  (QT) .  Then  for  each  tc=  1,2,...  there  exists  a  Borel  function  over 
Qt  taking  values  in  A  such  that 
a  a 

(4.7)  1/k  >  m  K(t,x)  F  K [u] (t ,x)  a.e.  (QT) , 

where 


(4.8) 


(t.x)  = 
[u] (t.x) 


m(aK(t ,x) , t,x)  and 


=  u. 


v 

V  a. . (a  (t,x) ,t,x)3.3.u 

.  *  ,  1]  K  1  1 

1,1=1 


d 

+  I  b. (a  (t.x) ,t,x)3.u  -  c(a  (t.x) ,t,x)u  +  f(a  (t,x),t,x). 

.  -IK  IK  K 

1  =  1 


□ 


Let  us  assume  the  following  conditions  relative  to  the  sequence  {a^.}  ob¬ 
tained  in  the  above  lemma. 


(A. 4)  There  exists  a  constant  k>0  such  that 

(4.9)  suo  | a  (t.x) [  <  k 

1<K<°° 

for  almost  all  (t.x)  e  Q^..  Q 

Remark  4 . 1  For  example,  in  3.4,  (3.18),  we  can  take  as  the  following 
function  (we  may  put  ma(t,x)  =  l):  for  any  <  =  1,2 . 


(4.10)  oiK(t,x)  =  -  /2  Vv(t,x)/2. 

Note  further  that  in  this  case  Vv  is  a. a.  bounded  on  Q^,  (for  the  details,  see 
[4]).  Also  in  3.2,  (3.12),  (a  }  can  be  taken  such  that  (4.9)  holds  under  addi¬ 
tional  assumptions.  □ 


Let  us  assume  (A. 4);  then  we  have  the  following: 


4.4 


Theorem  4 .  J  Let  u  e  (Qj)  n  c(Qj)  for  any  p  >d  +1,  and  also  let  (4.1) 

be  satisfied.  Let  m  (t,x)  be  a  regular  normalizing  multiplier  satisfying  the 
conditions  of  Lemma  4.2  and  the  relation 

(4.11)  m“(t,x)  <  N(t,x)ma(t,x) 

for  all  (t,x),  where  N  is  bounded  from  below.  Assume  that  for  such  m, 

(4.12)  j  Gm(u](t,x)  <  0  a. e.  (Qy) , 

^  u(T,x)  >  g(x) ,  x  e  Rd. 

Moreover ,  assume  that  there  exist  nonnegative  constants  k,  m  such  that  for  all 
(t,x)  eQ^,  0  <  5  <  1 ,  £  e  Rd  such  that  U j  =  1 , 

(4.13)  D^fiu(t,x)  <  k(l  ♦  |x|)m. 

Then  it  holds  that 

(4.14)  u  s v  on  Q^.  G 


Since  the  proof  is  almost  the  same  as  the  one  for  Theorem  4.1,  Lemmas 
4.2  ~4.4  in  [3],  we  omit  it  here  (although  we  have  to  modify  it  slightly). 
Finally,  by  combining  Theorem  4.1  with  Theorem  4.3,  we  have  the  following 
uniqueness  result  of  Equation  (2.5)  . 


Coro l lame  4 .  4  Let  u  e  W*  ’ (Q^)  n  c(Q^)  for  any  p  >d  +  l  and  also  let  (4.1) 

be  verified.  Suppose  that  u  satisfies  the  normed  Bellmann  equation 

¥ 

Gm[u](t,x)  =  0  a.e.  and  u(T,x)  =g(x),  x?Rd,  for  a  regular  normalizing 
multiplier  m  satisfying  the  preceding  conditions  made  in  Theorems  4.1  and 
4.3.  Furthermore ,  let  us  assume  all  of  the  conditions  made  in  Theorem  4.1 


□ 


and  4.3.  Then  u  =  v  on  Q^. 


4.5 


Remark  4.2  It  is  not  hard  to  prove  that  for  the  examples  in  Section  3,  such 
as  (3.12),  (3.18),  etc.  (under  some  additional  conditions,  if  necessary),  the 
uniqueness  theorem  holds.  In  fact,  it  is  sufficient  to  note  that  (A. 4)  is  true 
and  that  m^  itself  has  such  properties  as  ma.  It  is  also  shown  that  the  cost 
v  satisfies  the  same  condition  (except  (A. 4))  as  u  in  Corollary  4.4  under  the 
assumptions  (A.l)  ~(A.3)  or  (A.l)'  ~(A.3)'  or  (A. I)'1  — (A. 3) *  * .  (cf.  [3]). 
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